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[0 0 7 4] 

®6&bf^i^*>^-^3>&^^&cU n- KJE*t > httjl^St 
[0 0 7 5] 

6 o 2 jcjsvnt. 

Z<DG0m<DZ? V-J*(Dmtf'(># U h£*l£o 6 0 3 (H7) fcfcV^T, 
[0 0 7 6] 

Zl<Z>B#lCl±, >>r-*y^y:/6 0 4 tCteA*;, S%fil»ntf, ^f9^6 15 
lCliAU*i"o 6 0 4lC33^T> T5j^<Z>last_gop_startte r n ew_gop_startj -fit 
K£-DT%jmWt%.ZftZ>o 6 0 8i:6 0 9ICSV>t> 1 <fc V U- Aj 
^^V^V^&VNj^ib, oT^O riast_gop_stopj Tframe-lj lC^^£*l 

S„ S&fctttUi. ltt*6 10© riast_gop_stopj lC^5££*l£o 
[0 0 7 7] 

^0DX^y^> 0 8lC^TffrffllC*8^*l£ 6 1 1 tt, i^7^-^60 5 
, f^^f^-/xyi/*;l7^-^6 0 6, feJ:0f*IB3K>f > h-5=-* 6 0 7 {c 

[0 0 7 8] 

!7l/-Aj (~©G0Pfttf>7 l/-A©ffc) ^&^ot^Sn-KIHt>Mt 
frL^GOPCD^Ttfm 0 ^*-* £ffif&7 U-l±mz& o TM^* f (new_gop_s 
tart) „ 

[0 0 7 9] 

^tKD^lc, bT^(Z) rn^i/-Aj te, ofc«fct>* r^^j tf-aim.® r n ew_go P _s 



3 0 
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tartj lZ^-^^tl^>m^<Oy I/- ASIC "fey h£*l£o -?:(Dm. Xff^6 15 
[0 0 8 0] 

[0 0 8 1] 

0 7 11 =kb«J^tf> Tn^Lz-Aj #M©«|»I6HR^ (I/P7 1/-A 

[0 0 8 2] 

i©»^ttKT?»y, ^©^F, ry^Sj tfjltfftT, 7 0 2tCfcV^ b 
[0 0 8 3] 

■ itl* ? SCHT*»*<fc&li. ^7 0 3 ttStitlT. fcLGOPft© r g op_min 

[0 0 8 4] 

7 0 2©i*^ r&^j *e**3&e>fcC, ifbv%G0P«7 o 5i*T?$&«>e>;ft£. 

7 0 3©ra*#tt^T?&*fce>tf, 8rLV*G0Ptt7 0 SIZ&VfrfrV *"T. 
[0 0 8 5] 

7 0 3©^ rnn*j T?»<5«S&tf, h 7 0 4 iCttAU* t. 7 04 

r«v>j T*&s&e>tf, G0Pttx^^^"7 o 6 w*egace>tiT. 

[0 0 8 6] 
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[0 0 8 7] 

mwrt v * - # £ m o <d x-n^nrnx-mm l & © © £ #>mmx* % & r ^ ic&s 

[0 0 8 8] 

[0 0 8 9] 
[0 0 9 0] 

8 0 11C^V%T> Z.<DV7)l'-?'><D$Emtf%0Mm%.t$tl2>. RT^(D rframe_ 
noj riast_gop_startj — $<DzH/t>V £#*:£>*lT, rT^© r -» 

ZT >^> x ytC^V>T3^^E(Z)^Ix — A, rframe_noj ©fr U VA*$fg/K>f > h ©fltlC 
<fc *J>f h$*l5 0 
[0 0 9 1] 

;*"T-y:78 0 3 ICfcV^T, -r^hStl* =fo b «T^© I" 1 ast_gop_stopj CD U > 
T-^y *y "HR© rframe_noj ©n y#«fc *J /J> £ . 0 

4^3iAU £%&tt*U;f, S^fy7°8 0 2[caA5. 
[0 0 9 2] 

Xf>yy8 0 4{CfeV>t, % bftf^oT&^tlfcA^;*-* Tsummaxj ©? 

*>© i o©8o«fc y *r^© r-^-ffj ©^#/Jn£ v\&e>tf, £©flf©4l2 

0 0 $:^#oTV^T•5 i X h$tlS„ 
[0 0 9 3] 
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[0 0 9 4] 

^T^^8 0 5(:fe^t, tjLiu&oT&je^Jl&A^* — # Tsummaxj ©1 

o©4^© i <fc »j nr^© r^-tfj ©fliavj^^&fjkr, ^-tu^x h^tis. 

[0 0 9 5] 
[0 0 9 6] 

8 0 4 8 0 5<D&l£AV Pttn- F^ilhi> b Xt- b<Dfem£mz<&&* 
[0 0 9 7] 

*g*SD£ <fc fBi£#9& CD #> ©DSfcfc m^MPEG- 7 * # 5 s - # W£ K V % T $ tl 
[0 0 9 8] 

S®£^1-o 9 0 jRW3&«*JKDS"r3Qit>^-fe^>NDS9 0 4, ifc^tf*-? 

-f 7-ff?gDS9 0 2 feSiftS. 
[0 0 9 9] 

±?*> hDS9 0 4*&, b#8?9 0 6#3r&ftt3ft«. 

[0 10 0] 

•fe^* > h#fl?9 0 6#'&7 "tT^-fe^V hDS9 0 7, £ £tflfr£«cDS9 
0 7#5l£ffl3*lS. 
[0 10 1] 

tf'7 s rt"fc*'*> hDS9 0 7fr£>, iZ^^^hS^V^fcn- Ktit> hDS9 0 

9 (hi 4) tfgigfflsns. 
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[0 10 2] 

- hDS9 11 (0 1 6) „ 
[0 10 3] 

Ifr£f!i|lcDS9 0 8;fr&. b^V^a- KIHftfc: 

^^DS9-r O ~(@"l 4~)~##£ffi^^ 

h*^- hDS9 1 2, £J:tf01 6iCT^"feX-t-5o 
[0104] 

j*-r-fyff#DS9 0 2^f>, *-r>f 7~?U7 4 — )1>DS 9 0 3#3[£ffi£*l&„ 
>l^7^n7>f-;i/DS9 0 3^e), — 133- hDS9 0 5, (010 

) #ei^ffi£*x&o 

[0 10 5] 

01OH n- K^^tl> hDSl 0 0 1. y-^7*-V*/hS§DS100 2 
(011), ;iSJ:tf£fcttS«l:7*-Vy h^DSl 0 0 3. fcJ:tf01 

[0 10 6] 

tfftlimc. K^mt:> hDSl 0 0 1 -^3-K^tt>bDS10 04 
(013). fc.fctFloCDtf^S/aXDH- K^SIff #flS^$tSDS 1 0 0 5 (0 
1 5) <D 1 oOD^-^^a >©MA^^oTV^t. 
[0 10 7] 

011(1 y-X7*-7^h^in-KIit:>h^3if-^^^U ^£*i 
[0 10 8] 

s i ze_of _p i ctur es& # >f ^ £ * *> < 2 * int>. x£ y# ft <Z) V - * ^1^^ 7 * - V 
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number_of_f rames_per^second& # >f V° £ =fo t> , V — ^Ziy^-yV <D 2. 

[0 10 9] 

P ixe l_as P ect_rat i o& # ^ ^ £ & %<i 1 oat\ fcf ^ -fe ;i/^#,Jt £ gftlE "T 5 „ 
[0 110] 

^pixel-co^^^ 

[0 111] 

usage_of_progressive_interlaced_formatlii?--f X$: ; fct>< 1 bit>, 
[0 112] 

usage_of _f rame_f i eld_pi cturesliiJ- >f X & ^ ^ < 1 b i t>. t)U7l/-Attti 

^ - jv f tf * r ^ #£&b*i s & h z> o 

[0 113] 

compress ion_method&#>f V — ^.7*— W h 0>£:#>lC^fc> 

*lfcJE33i#&£/tiSU 'JXhO^^fflferot^S. :MPEG-K MPEG- 2, MPEG 
-4, DV, H. 2 6 3. H. 2 6 1 & £"t^T ©JE*g#£5 <fc »J — JI<Z>^*-*©fc 

[0 114] 

GOP_stucture&, I/P/B-X^- h > l/> V^W ^it^— * V <i —)l> K*l?& 
So MPEG-2 \?<T*K.-£m-7 l/-A#&3>fce>fc£. JM2*l£:^ctf>D 

[0 115] 
[0 116] 
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[0 117] 

size_of_pictures«:#>f y£ 2 *int\ x£y-ftfa(D UW®M%7 * ~ V V 
[0 118] 

" humber_of_frames_per_second^^ 4 zf Z%*r(M.f8t)~ 2 # 

[0 119] 

p ixe l_as P ect_rat i o& # >f ^ £ t> <f 1 oat\ tf * -fe ;i/|g^Jfc £ it £ . 
[0 12 0] 

pixel_colour_de P thtt^>ry$:^^(^), fi^§^l|t§ 0 
[0121] 

usage_of_progressive_interlaced_formatli-t?--f X$r%^>< 1 bit>, % L BUI 
[0 12 2] 

usage_of_frame_f ield_pictures&-!J--f X**>%< 1 bit\ 

compress i on_method& # -f !7* £ % % iMW) , V — X 7 # — V y h CD #> iC^fc *l 
fcffi#l&;£&£j^U 'Mh0^^0t)0t^5„ :MPEG-1. MPEG-2. MPEG- 
4, DV % H.2 6 3, H. 2 6 1 & if "^-^T <fc l J-f 0A5^ — &<Dlc.#) 

[0 12 3] 

GOP_stucture&, I, P, B-^f - h©t^^a>©7>U>^f f ftf-^ 
[0 12 4] 
[0 12 5] 
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01 3 tt-JKn- F^&fc> F**^-* -efttt^ttcDSMSjBiis/^ 
[0 12 6] 

— use^regl on- of ~i n terestiDS f« -® J^'^f^^^^t^^fij^^C^M^^ - 
[0 12 7] 

r eg i on_of _i nterest_DS#^ t> tv -5 £ V \ tf & V a e> -£ tf> B#M A J£* T CD 5 © 
1 oT'&Sjb^btl&^shapejK : m*fc<OM&*Qffi> B^fSffrlClWt -5 fcftfC 
% boundary_box_D, MB_shapeJX £ fc&motion_trajectory_D£ £. % IZ if <D<fc 5 
fcAfiCOshapejOT^^JST^Sit- „ MB^SS^^ti, *Zf*Jx. V F7£IBj£CDfc#)<Z> 
*M©:/Dy? (1 6x1 6) -^m&to-fUv ^fc^V^-T. 
[0 12 8] 

motion_trajectory_D&, start_f ramefc «fc l£z.<E>region_of_interest_DS©end 
_frame^^^$4xS<ke> IC, f T*lZ9$f%<Dm&*'£&$. ~? * region_of .interest 
.DSli-fg* ©shape_D33 <fc CDmotion_trajectory_DCDit-f X5:#ot^tt 

0 3 — Ffi7'/y j !r-^3>Otfc(:, region_of_interest_DS#$6;b*i;tT 

•€ti^IE It < V'O $:^i5fcOfl^l^©y D y * K$it> 
[0 12 9] 

MPEG-4/\©ffi©^ii=l- KftT^U^T-S/a seperate MPEG-4 tf?^ 

ai? hfc J:oTf|i*tf>Mc£f&f9!ir5 U ^9fW> FCD<fce>&ffiCDMPEG- 

-Al/- FlC^?>£*l5fc#>lC 0 
[0 13 0] 

-®region_of_interestJ)SCDttaj&&lftWlC, £ £tt#i&T'H*T-e^ o 
[0131] 

use_editing_effects_transfercoding_hintsli-?-(Z)^$ t>< 1 bit>. 
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[0 13 2] 

camera_flashte, f <D AJjtiK *> * ^ 7 7 V 1/ ^itUZ. Z> y \s - 2±M*WL 

^n-^Jg^StbaiSitV^ ^IC^&T?&& 0 Peter Kuhn: "Algorithms, 
Complexity Analysis and VLSI Architectures for MPEG-4 motion estimatio 
n", Kluwer Academic Publishers, 1 9 9 9. 

y^y ya.tzl,<D*><D%:W~D <D 2 -D(DjzM.<Dy*U y V <Dffl<D^-i%ffiM 

[0 13 3] 

fi£oT. 3- KJEiftl^©*^^^^^ grille J; *j, 

gS*^^^7^^i/n.lC<fcoT^|7U-A (s) friby U-2**^m-?Z>Z-£%: 
«T |g fC f -5 © <D «> 3 tt 5 o 
[0 13 4] 

cross_fading«, i-^T©A^J^*SS©7 3i- K©t*H$&:7 U t7 U 

107x- K>f<> hCD^CT'2111 
[0 13 5] 

3- K^&£> h * 5f-^fflffiS©7i- R>f h ill*. fgS<£> 



aj!I# 2 0 0 0- 3 0 



#2000—068720 



[0 13 6] 

black_picturesttu "T^T 0 A# \/~ -ki3,fctf— SfiCD^fcT*^*© 

MIS^^^^^^oTVx^^^-e^S^-e, ^bTthattfrf1s*iv%DCT:i:> 

£ SUPK-r £ * ICM v ^ h ti x. * "To 
[0 13 7] 

fade_inli|gS<3D7ai- F^^SlT*, ^t'©7x- 
:7l/-A£8t5£-r£A7J©#< illPStlS. ffiSO^ni- KlCjfc^T, 

[0 13 8] 

mffi&mz. — ^©MV^*^#mtE£*l£©7?> fade_out», £A,&{C3S 

v > iz j: o t &sfi ic ii o ^ y *■ * <fc e> JCH 7r& S o 

[0 13 9] 

abru P t_change&(MI£)> L©g§£§©*§® £ 3 V hStfttf 

[0 14 0] 

MAtf, zftt><D-<'0 Mils 3 (D^^c^v^^<t:^i^v^fc^-^^c e ^: y^£*i 

S„ Zl*ie>tf>fcr-:7«:#TbV^;* 7^>a y h £ fctt#ffi©*#J£^-r£o abrupt 
_changeiB&$r5l l* 7 a: - il *f 3 £ 7?& £ . 

[0 14 1] 

-£©t$©2o©if^ I ;*-fe?'* > h©im©^©^tf:#m3l1-&BHc^ #rl/V> 
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& CO tc «> IC ^ 2£ tC « fc> 41 3. * "T . 
[0 14 2] 

use_motion_transfer< 1 bit>coding_hints_DS : U ^©^^ £ Kj^ggSl 3 - 

F^^>h^^^^feM^i--'5o L ~- 

[0 14 3] 

number_of_regionstt, J^T©S*f^K^3- FIE* t > h * * 7 s - * 
[0 14 4] 

$07^ -;i/KlCcfc U^$tlSfor_every_region 0 flg«#3l&S&K:AfMt3*l& 
[0 14 5] 
[0 14 6] 

y - * (Dmm&MftcD^ oMttmm & 3 - fa; v r ^ 5 © £ & tc, 

(re-) ^-5Hfc3P#CD n > fcTa - # ^S^lfr^McD^x U T SrHaRi" 3 £ 
[0 14 7] 
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SHSjStlZ^* > YOt~®><D (re-) enencoder/^>fb:n>3- #Wtfe 

[0 14 8] 

[0 14 9] 
[0 15 0] 

IJ-rame.locationte, Z.OWM%fa(Dl-'7 U — A^^g^g^B^f £ < ofr© 
[0 15 1] 

select_one_out_of_the_following»-y--Y>C$: : b , ^<2bit>, J£<TC?)I-7 I/ — A 
[0 15 2] 

ft%>first_frameW;1*-^>C 1 bitX 7=:7 h 1-7 \s - I*®M.~£ $> 2> * 
[0 15 3] 

list_of_frames«, ZlO^Hi^-fey^ > h [%CD}&]&}fa'V%)Z> "7 V — 2*fO)(.<D V 7» 

<k*int>Tf&Sc 
[0 1 5 4] 

*t»first_frame_and_every_k_frames{i-9->rXS: : fot)(^EfS:), 30Di2^^> h 
ft<DM%i<Dy l/-2»ttIntraT?&y, kl±#U£^;-fe > hP^0I-7 l/-Atf)fS£ 

[0 15 5] 



mH#2 0 0 0-3 



#2000—068720 



no_I_frame#-9--f X&t>*><l bit\ Z. (DUU^ V * > h (Dft^ittfttjO) M 
[0 15 6] 

^ > H ^ia^-reo - — — — — •• — — 

[0 15 7] 

target_bitrate«-9->f X£%t>(^$:K 2#B&fc>J B^tfy h I/- h&dtf) 
[0 15 8] 

target_max_bitrateli-b--f X £ % *> (SlIfcK 2#B&£: *J«*© B^lf y h V 
[0159] 

target_Bin_bitratetti^>f X^=fe;t>(M^t). 2#B&fc »J S^^^ h ^ 
[0 16 0] 

use_transfer<lbit>coding_statesli-9--f X&=fe*K 31 ©m^-fe > h tf> 
[0161] 

^^|coding_state_nri±-tJ--f X£ (^l&K Z.<D1zy*> h (Dtc#><DZl - K 
[0 16 2] 

add_new_transfer< lbit>coding_statel£-9->f X£=fot>> =fo l/K^Lfcff 

"I" S. add_new_transfercoding_state# rjiv^ ^-fg^^tex. 
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So 

[0 16 3] 
[0 16 4] 

<ibit>%,u®i 5izte^T%.m2ftz>&o-&& vnmttw&iiflQ&tiVBs&i* 

9&#4&j34l&j&9£# c && 35c use_encoding_complexity_descriptionli-9->f 
[0 16 5] 

HISS, 3- Ftfttt!3=z- KgE&t:> 1***5*-* &ia*U 
[0 16 6] 

use_feature_ P ointsli-9-^X§: : fot»<lbitX #|g#>f > bM^^t-Mm^m 
[0 16 7] 

select_feature_point_methodli^-f =b t>< 2 bitsX «ifg/K-f > h 
[0 16 8] 

7 I/ — A&fc. y number_of_new_feature_pointsli, gf 3 &C;£^Tz*£*V£ <fc t> 
frames* int>„ ^ - h ^^7?^^ Zl *U£, 7 U- fe »J fr b VM1 >t=- > X V tf>* 
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[0 1 6 9] 

feature_point_metrics& > 1 > hfafty \s-J±%>t=. *J§rbV%featu 

re P ointslctto*<^#^(5[)U^ h (MB) &>T (DMmz & ^> T . flBfffi 

c^^ip^tt^ly— ^at-t^r^~ ■ ■ ~~ - — * — : 

[0 17 0] 

use_equation_description«, 7U-Afefc.|j «F#ffclM£3 (D^g^S 

[0171] 

use_mot i on_descr i pt i on & # ;7° £ £> < 1 b i t>, gfrff^ -5 V > $ SS 3£ © 
[0172] 

select_motion_methocU±# >f t, *,<4 bits>, gfrtfsfai&7j "T. 
[0173] 

param_k_«otion»^^f ^%%t><nframes*k*intX kj*9* — # fc^n— At/I/fc 
[0 1 7 4] 

motion_metricsli, Ifr^? h ^©l^ XtcS^5 < ^flstf) 

TOS«*tC«k-3T^,-&e>4l-& 0 : max. "i^ t^O^D y *ffr£ 

h;i/©stddev„ 
[0 17 5] 

block_motion_field&, ai*»7n V ^ \J"i£i&#>!frf£:7 ■< — ft/ KOt^t©^^ 
h-Jl/lcSWilb* X<n><frames*int*size_x*size_y></>"e&£>„ < (m* 
■) >= 

[0 1 7 6] 

use_texture_edge_metricsli^*t?fey, ^tl&iz v h £ tl6„ -£-©B£-5^;^ 

^-^feiix^^#^i±^^T, -en&iM x&*>oTv*£ir< ibit> 0 
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[0 17 7] 

select_texture_edge«-9->f X 4 bit>, ^*U±, ffl^*^ * - h fr&X* 
[0 17 8] 

DCT b 1 ock_energy 1 -D<DZ?U y 9 CD ^ T <Z>DCT-^gC©-£ft*?? & V , 7 

<size_y*size_x*nframes*int/ 6 4 >„ 
[0 17 9] 

DCT_block_activity_metricli > 1 -D<DZfU y V #*lH=bDC#$Cfc bt'feSo 

#>C^^£*lT, if>TX-e$)-5o <size_y*size_x*nframes*int/6 4> 
DCT_energy_metric«, 0#^tf> U X h l^O^D <y * ©M* CDDCTfglfr^C 

X hT^)S©^J^T©Sl*lC<koTM,-&e>tl-2>o . : max, min, $931, 

[0 18 0] 

tB^©it-f xtt-ee>^feSc <6*int> e 3<z>ia^©^t>*; >zfv * > 

"r—t/n DCT_energy_me tric& If -x^-^y^ > h^-T^TO^— ©7 U — 

<MC |Bi£ 1" £ i^H ft & £ o 
[0 18 1 ] 

DCT_activity_metric«u iifC'J^h^, fi* (Z> ~fU y V £>{@* <E>DCT?'£i& 
U X h^feSCD^T©SlfclCJ:or^,i±e>tlSo : max, min, f 

^r©«-^©xT?smaR#^©»«ii. BB^c^xtt-e^-c*^. <6*int 

>» 3©fB«E^©f^*5y©-f >^U^>r-i/3>tt, DCT_activity_metric£lf 
[0 18 2] 
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[0 18 3] 
[0 18 4] 

— - -^bitrate z fraction_f or_m^ ^- 
[0 18 5] 

9 bitrate_fraction_for_P»i5t>f 7"$:t)t><f loat\ P7 I/- AOfetfUC^*)*!,-? 

B-:7l/-A©£«><Z>fc^ hi/- h/MfcSP&l 0 0%\Zrt-My^—*J<DW)~Z%> 
[0 18 6] 

*^ft_scale_ratio_IJ>ki:#^:^&&%<noat\ (StC. M^t^-yV (31 
[0 18 7] 

*^ft_scale_ratio_I_Bte#>f <float\ f^tC, t * >?T - Jl> (Zl 

bt< ]££V^ thatlf v his- h|3^^ (bitrate_f raction_for_I % bitrat 
e_fraction_for_P) M^Hfc_scale_rat iofBM^- (fi^ffc_sca1_ratio_I J\ 
{t_scal_ratio_I_B) OT<D I/- h 3 > h n * - # l±gS^B?f7r 

[0 18 8] 

X_I. X_P, X_B&frame_vbv_complexities-£& \) (M$t)> >f 
»J, "7 L/-^*0*<BE*iS^7^-Vy h(cf(DWf&lZfemZfrZ>o ®12)„ ZL 
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[0 1 8 9] 

X_I_top, X_P_top, X_B_top& % — ^r±0y-( —)l F<Z>£«><Z)f ield_vbv_compl 
exitiesT*&*J (MB), "tti^ft* J zfX&V s 7 A -JV F*^< BEtt UW^Z? * 
-vyh(cf(D^i:ti^n6 0 012) o 

[0 19 0] 

-X- I-botr- X^Pzbot, -X-B-bot&^jK K J*V^— KCD CD f-i el d_vbv_comp 1 ex 

h(cfcD^lC^«$tl^ 0 01 2)„ 
[0191] 
[5§^©^] 

[0®©ES^fcM] 
[01] 

MS©*y ht7-#©HM#Jfc=i- KS&fc^T^JCifcv^Tai^rJ&tgttSt*- 
[02] 

3- K^siti> hflim&^-r gop) 
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Broadcast Contents (MPEG-2) and related Metadata (MPEG-7) Distribution 
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Contents 

Buffer 



Transcoding tints 
Generation Unit 



105 



Audiovisual 
Transcoding 
Unit 



Audiovisual 
Transcoding Hunts 
Metadata Buffer 




MPEG-4 
Internet Camera 
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Home- video 
camera 
(e.g.DV-format) 
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Wireless 
MPEG-4 Video 
PDA 



High resolution 
audiovisual 
terminal 



Audiovisual 
Game Console 



ITU-TH26S 
Videophone 
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Buffer 
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Audio visual 
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Unit 
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Audiovisual 
Target Format Buffer 
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Source Format 
Description 
Buffer 



206 



L 



Transcoding Hints 
Metadata Buffer 
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Transcoding Target 
Description Buffer 
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Extraction Unit 
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number of new feature pointss per frame 
MOEG-7 test sequence : newsl.mpg, first 2000 frames 



camera shot change or scene change 
— > new audiovisual segment starts 
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[04] 



Transcoding Hints State 1 : 
•low scene activity" 



Transcoding hints 
metadata for state 1 : 

• GOP structure, 

• quantizer_scale, 

• M : I/P-distance 

• Wtrate fraction : I/P/B 
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Transcoding Pints State 2 
"medium scene activity" 



Transcoding Hnts State 3 
"high scene activity" 
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Transcoding hints 
metadata for state 2 : 

- GOP structure, 

• quantizer_scale, 

• M : I/P-distance 

• Wtrate fraction : 1/P/B 



Transcoding hints 
metadata for state 3 : 

• GOP structure, 

• quantizerjscale, 

- M : I/P-distance 

- bitrate fraction : I/P/B 
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Source Contents 
Buffer 
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Description 
w Buffer J 
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get Description 
Buffer _ 



motion vector,DCT-ooeffident,feature points extraction 
from uncompressed or compressed source contents 
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analysis 
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texture/edge 
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feature point 
tracking 
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number of new feature 
points per of frames 
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temporal video segmenta_ 
tkxi ; startnaof frames 



selection of transcoding hints 
state for every segment 



motion related 

transcoding 
hints metadata 



texture/edge 

transcoding 
hints metadata 



feature point 
transcoding 
hints metadata 
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ment transcod. 
ing hints 
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Q START ^ 



601 



frame = nframes = last_jgop_start = lastjgop_stop = 0 ; new_gop_start=0 ; 
new ,^gap_stDp=0 ; new_seg=0 ; 




motion parameters 



texture/edge 
parameters 



feature points 
data 



last _ J gop_start==fram--l ; 



last jgop_stop=-l ; 



T 
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determ^^ 



transcoding hints output : nframes,1ranscodirig_hints_state, new^gop_start ; 



i 



nframes =0 ; new jgop start = frame ; 
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frame = frame +1 ; 
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( END ) 



ttJEW 2000-3040322 




#2000-068720 



[B8] 



the ccnstant summax 
is the maximum 
number of featurepoints 
which can be tracked 
from frame to frame 
multiplied ^ty_the number 



c 



START 

I 



801 



of frames between the 
frames lastjjop_start and 
last jgGp_stpp 



frame_no=last jgopjstart ; sum=0 ; new_seg=0 ; 






,802 


sum = sum + new_featurepoints [ frame_no] ; 
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Generic AV DS 
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Media Info DS 
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Media Profile DS 



Segment DS 
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General Transcoding / 
hints DaFIG.10 
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Segment Decomposition 



Z 
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Video Segment DS 
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Moving Region DS 



0 1 



^1 



909 



Segment based 
transcoding hints 
DS.FIG.14 
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Segment based 
transcoding hints 
DS.FIG.14 
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TrarB.Encod Com- 
plexity DS.F1G15 



Transcending hints 
state DS.FIG16 
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Trans. Encod Com- 
plexity DSJIG15 



TransconAig hints 
state DS.F1G16 
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[01 0] 



1001 



Transcoding Hints DS 



1002 



Source Format 
Definition DS, 

FIG11 



1003 



Target Format 
Definition DS, 

FIG12 



o 1004 <y 



General 
Transcoding 
Hints DS. 

FIG.1S 



1005 

1 



Transcoding 
Encoding 
Complexity DS, 

FIG15 



[01 1] 



1 : bitrate < int > 

2 : size_of_pictures < 2*int > 

3 : number_of_f rames_per_second < int > 

4 : pel_aspect_ratio < float > 

5 : pel_colour_depth < int > 

6: usage_of_progressive_interlaced_format< 1 bit> 

7 : usage_pf_f rame_field_pictures < lbit > 

8 : compression method < int > 

9: one out of list{MPEG-l, MPEG-2,MPEG-4,DV,H.263,H.261,. 

10 : {further parameters for compression method} 

11 : GOP_stucture (Runlength coding) 
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[01 2] 



1 : bitrate< int > 

2 : size_of_pictures < 2*int > 

3 : number_of_frames_per_second<int> 

4 : pel_aspect_ratio< float > 

- 5 : pel_colour _depth < int > - ...vj _ 

6 : usage_of jprogressive_interlaced_format < 1 bit> 

7 : usage_of_frame_field_pictures< lbit > 

8 : compression_method<int > 



9 : one_out_of Jist {MPEG-1,MPEG-2,MPEG-4,DV,H.263,H.261,_. } 

10 : (further parameters for compression method} 

11 : GOP_stucture (Runlength codling) 



[01 3] 

1 : use_region_of_interest_DS : < lbit > 

2 : region of interest DS : 

3 : shape_D : select one of {boundary box D,MB shape D, shape D} 
4 : motion_trajectoryJD 

5 : 

6 : use_editing_effects_transcoding_hints__DS : < 1 bit > 

7 : camera_flash {framel,frame2, framek} < k*int > 

8 : cross_f ading { (start_f ram,end_f rame ), } < k* < < int > , < int > ) > 

9 : blackj)ictures { (start_frame f endJFrame) t } < k*( < int >, < int > ) > 

10 : fade_in {Cstart_frame,end_frame),._ }<k*(<int>, <int>)> 

11 : fade-out { (stert.f rame,end_frame).._. } < k* ( < int > , < int > ) > 

12 : abrupt_change { f ramel , framed _ framek } <k*int> 

13 : 

14 : use_motion_transcxxMng_hints_DS : <1 bit> 

15 : number jof_regkxis : <int> 

16 : for_every_region : 

17: is_regkxi_rectrangular_shaped (y/n) : <lbit> 

18 : if_arbitrarily shaped : use region D for this region 

19 : describe parametric object motion for this region 
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1 : start_frame< int> 

2 : nframes<int> 

3 : I_frame_location : 

4 : select_one_out_of_the_following : < 2 bit > 

m 5 J first frame , -( d efault) T ^ _ : ._, •-, _ 

6: ~ list of frames {framel,frame2, ...... frame k} <k*int> 

7 : first_frame_and_every_k_frames<mt> 
8 : no_I_frame 
9 : quantizer_scale<int> 

10 : target_bitrate < int > 

11 : target_min_bitrate<int> 

12 : target jmaxj>itrate < int > 

13 : use_transcoding:_states (y/n) <1 bit> 

14 : transcoding_state_nr < int > 

15 : add_new_transcoding_state (y/n) <lbit> 

16 : if yes : {list of parameters} 

17 : remove_transcoding_state (y/n) <lbit> 
18: if yes: state_nr<int> 

19 : use_encoding_complexity_description (y/n) < 1 bit > 

20 : if yes : encodin^_complexity_description_scheme 
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[HI 5] 



1 : use_feature_points {y/n} < lbit> 

2: select_feature_point_rnethod<2 bits> 

3: number_of_new_feature_points<nframes * int> 

4: feature _point_metrics { mean, max, min, var, stddev }< 5* int> 

5 : use_equation_description (y/n) < lbit > 

6 : use_motion_description (y/n) < lbit > 

— 7~: ~~~select~ihot*^ - • — — - 

8 : para ni_k_motion < nframes *k* int > 

9 : motion_metrics {min, max, sum, var. stddev} < 5* int> 
10: blcx;k_motionJBeld<nframes *int* size_x_size_y/(m*m) > 
11 : use_texture_edge_metrics (y/n) < lbit > 

12: select_texture_edge_metrics <4 bits> 

13 : DCT_block_energy <size_y*size_x*nframes*int/64> 

14 : DCT_block_activity <size_y*size_x*nframes*int/64> 

15 : DCT_energy_metric{ mean, min, max, sum, var, stddev} <6*int> 

16 : DCT_activity_nietric {mean, min, max, sum, var, stddev} <6*int> 
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[Hi 6] 



1 : M : I/P distance <int> 

2 : bitrate_fraction_for_I < float > 

3: bitrate_fractian_for_P < float >/* bitrate_fraction of B is rest to 10096) 

4 : quantizer^scale_ratk>_I_P < float > .. 

~5TquSitizef j5cale_ratfc01B~<: floSt :> " " ~ " 

6 : if_frame : /* see target format transcoding hints */ 
7: X_l, X_P, X_B <3*int>/* frame_vbv_comp]exities •/ 
8 : if_field : 

9: X_I_top, X_P_top, X_B_top<3*int>/* field_top_vbv_complcxities */ 
10: X_I_bot, X_P_boU X_B_bot<3*int> /* field_bottom_vbv_complexities •/ 
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